This is an evaluation of forecasts for Covid-19 case and death numbers in Poland submitted to the European COVID-19 Forecast Hub. You can find more information on the European Forecast Hub Github page.

This report is intended as a basic evaluation of forecasts that helps modellers to better understand their performance. The structure and visualisations are likely subject to change in the future and we cannot rule out any mistakes. If you have questions or want to give feedback, please create an issue on our github repository. Note that all forecast dates have been changed to the corresponding submission date (every Monday) to allow easier comparison.


Forecast visualisation (Poland)

Forecast visualisations. The date of the tab marks the date on which a forecast was made.

2021-03-29

Cases

Deaths

2021-03-22

Cases

Deaths

2021-03-15

Cases

Deaths

2021-03-08

Cases

Deaths


Forecast scores (Poland)

Scores separated by target and forecast horizon.

Cases

1 week ahead horizon

2 weeks ahead horizon

3 weeks ahead horizon

4 weeks ahead horizon

Deaths

1 week ahead horizon

2 weeks ahead horizon

3 weeks ahead horizon

4 weeks ahead horizon


Evaluation metrics


Scores over time (Poland)

Visualisation of the weighted interval score over time. In addition, the components of the interval score, sharpness (how narrow are forecasts - smaller is better), and penalties for underprediction and overprediction are shown. Scores are again separated by forecast horizon

1 week ahead horizon

Weighted interval score

Overprediction

Underprediction

Sharpness

2 weeks ahead horizon

Weighted interval score

Overprediction

Underprediction

Sharpness

3 weeks ahead horizon

Weighted interval score

Overprediction

Underprediction

Sharpness

4 weeks ahead horizon

Weighted interval score

Overprediction

Underprediction

Sharpness

If you want to learn more about a model, you can go the the ‘data-processed’-folder of the European Forecast Hub github repository, select a model and access the metadata file with further information provided by the model authors.